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(54) Method and device for recording sub-titles 



(57) Video recording according to the DVD-VR 
Specification allows to record only one sub-picture 
stream. Therefore, a new technique is provided in order 
to be able to record at least two different sub-title 
streams in such a way that the sub-pictures of the dif- 
ferent streams may be displayed optionally. A first sub- 



picture stream is directly copied to the DVD-VR disc, 
whereas a second or third sub-picture stream is trans- 
coded to Teletext format so that the data can be included 
into the video stream to be recorded on the DVD-VR 
disc. Thus, several sub-titles are available during re- 
playing a DVD-VR disc. 
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Description 

[0001] The present invention relates to a method of 
recording data on a recording medium, wherein the data 
include MPEG video data and first sub-title data. Fur- 
thermore, the present invention relates to a device for 
recording these data on a recording medium. 
[0002] According to the generally available "DVD 
standard the MPEG format provides up to 32 sub-pic- 
ture streams. Usually, such sub-picture streams are 
used to record various sub-titles, e.g. in different lan- 
guages, on a DVD disc. Thus, when replaying a DVD 
discthe user has the possibility to choose a specific sub- 
title which is displayed on the video screen together with 
video data. 

[0003] The recording of a plurality of sub-titles by sub- 
picture streams on a DVD disc requires a complex re- 
cording technique. Therefore, video recorders have 
been developed, the recording technique of which is 
less complex and less expensive but which can only 
record one sub-picture stream. A corresponding 
DVD-VR standard has been defined which describes 
the specific video recording on DVD discs. The user re- 
playing the video signals stored on the DVD-VR disc has 
the possibility to switch on and off the sub-title of the one 
srub -picture stream. However, he does not have the pos- 
sibility to choose another sub-title, as he can choose 
when replaying a DVD disc. 

[0004] Moreover, according to the state of art, it is pos- 
sible to "burn" a sub-title into a video stream. However, 
such a sub-title is always visible when playing back the 
corresponding video part. 

[0005] In view of the above-described disadvantages 
it is an object of the present invention to provide a meth- 
od and device for making available more than . one sub- 
title to the user when replaying a DVD-VR disc. 
[0006] According to the present invention this object 
is solved by a method of recording data on a recording 
medium, wherein the data include M PEG video data and 
first sub-title data, with a step of storing at least second 
sub-title data as character based information within the 
MPEG video data. 

[0007] The advantage of storing additional sub-title 
data in the MPEG video stream is, that additional sub- 
title information is available to the user if he has a cor- 
responding decoder which is able to extract these addi- 
tional sub-title data from the MPEG video stream. The 
features of individually using the sub-title data of the 
sub-picture stream are not affected by storing the addi- 
tional sub-title data within the MPEG video stream. 
[0008] According to an enhanced DVD-VR standard 
it may be possible to record one or more additional sub- 
picture streams on a DVD-VR disc. Thus, more than one 
sub-title stream may be recorded as sub-picture stream 
on the disc. Alternatively, more than one sub-title stream 
may be recorded within the MPEG video stream. Closed 
Caption, for example, provides such feature of storing 
more than one sub-title. 



[0009]_ Preferably, the sub-title data obtained from a 
sub-picture stream are stored as Teletext, Videotext or 
Closed Caption. The specific advantage of using the 
Teletext, Videotext or Closed Caption format is that most 

5 television sets currently available on the market are al- 
ready provided with corresponding decoders. There- 
fore, a user haying a DVD player and a TV-set with a 
Teletext decoder has the possibility to conventionally ac- 
tivate a first sub-title stream stored in a sub-picture 

10 stream on the DVD-VR disc and, furthermore, he can 
activate the sub-title stream stored within the video 
stream as usual Teletext by switching on the Teletext 
decoder. 

[0010] In a preferred embodiment the character 

15 based sub-title information is labelled by a flag inside 
the sub-title data, so that corresponding data can be au- 
tomatically identified as sub-title information. 
[0011] Furthermore, as already described above the 
video and sub-title data may be recorded on the DVD 

20 disc together with further data as digital information. 
[0012] MPEG video streams provide space for storing 
user data in picture layers or GOP (group of pictures) 
layers. This space is preferably used to transmit or 
record Teletext, Videotext or Closed Caption data. 

25 [001 3] The method of recording sub-title data may be 
improved by analysing the at least one incoming sub- 
picture stream. Such analysis is necessary for improv- 
ing a transformation from the sub-picture format into the 
Teletext, Videotext or Closed Caption format. 

30 [0014] As already described above, DVD-VR used 
according to the present invention provides the possi- 
bility of recording at least two sub-title streams. Both 
sub-title streams may be output from a DVD disc. The 
first sub-title stream may be stored conventionally within 

35 a sub-picture stream. The second sub-title stream may 
be stored for example as Teletext. However, one of the 
sub-title streams or ail of them may also be individually 
input by the user, for example with a keyboard. Thus, 
the user can input individual data streams to be stored 

40 on the DVD-VR disc either as Teletext or as sub-picture 
data. E.g. the user can input sub-titles personally trans- 
lated to another language, generate a sub-title stream 
foranother target group or record information, which is 
automatically generated and related to the content of the 

45 video stream, like the current date and time. 

[0015] Moreover, according to the present invention 
the above described methods may be implemented on 
a device for recording data on a recording medium, 
wherein the data include MPEG video data and first sub- 

so title data, with recording means for recording at least 
second sub-title data as character based information 
within the MPEG video data. Additional transcoding 
means may be provided for transcoding sub-title data 
from the MPEG sub-picture format to Teletext, Videotext 

55 or Closed Caption format. 

[0016] The inventive method is usually formulated as 
computer program so that it may run on a plurality of 
hardware devices. For installation the computer pro- 
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gram usually will be stored on recording media like data 
discs. 

Drawings 

[0017] Exemplary embodiments of the invention are 
illustrated in the drawings and are explained in more de- 
tail in the following description. 
[0018] In the Figures: 

Figure 1 shows a sub-picture unit including sub-title 
information; 

Figure 2 shows a typical color look-up table for sub- 
picture data; 

Figure 3 shows a typical table of Teletext colors; 

Figure 4 shows the principle of pattern recognition; 

Figure 5 shows a flowchart for analysing sub-pic- 
ture data according to the present invention; 

Figure 6 shows a Teletext row 0 corresponding to 
the sub-picture unit of Figure 1 ; 

Figure 7 shows a Teletext row 22 corresponding to 
the sub-picture unit of Figure 1 ; and 

Figure 8 shows the integration of sub-title data into 
MPEG video data according to the present inven- 
tion. 

Exemplary embodiments 

[0019] For recording plural sub-titles on a DVD-VR 
disc according to the present invention a sequence of 
MPEG sub-picture units will be transcoded to Teletext 
format and then integrated into a MPEG video stream. 
Such a sub-picture unit is shown in Figure 1 . The gen- 
eral structure of a sub-picture unit(SPU)is specified in 
the DVD standard, DVD Specifications for Read-Only 
Disc, part 3, Video Specification, version 1 .0, August 3, 
19S6, chapter 5.4.3 Sub-picture Unit(SPU). Accordingly 
the sub-picture unit comprises the sub-picture unit 
header (SPUH), pixel data (PXD) and display control se- 
quence table (SPJDCSQT) which includes sub-picture 
display control sequences (SP_DCSQ). SP_DCSQ de- 
scribes the content of the display control on the pixel 
data. Each SP_DCSQ issequencely recorded, attached 
to each other. 

[0020] Figure 1 shows an example of a sub-picture 
unit as it may be subjected to transcoding into a Teletext 
signal. As prescribed by the standard also the concrete 
sub-picture unit of this example starts with a sub-picture 
header (SPUH) including control information. The fol- 
lowing part PXD represents the pixel data field. In the 
present case the pixel data are run-length coded bitmap 



data. The grey graphic field in Figure 1 exemplarily rep- 
resents a subtitle graphic, which is stored as bitmap in 
the PXD. 

[0021] As described above the PXD is followed by the 
5 display control sequence table (SP_DCSQT). The 
SP_DCSQT may include several display control se- 
quences (SP_DCSQ). In the case of Figure 1 the 
SP_DCSQT contains two display control sequences, 
SP_DCSQ#0 and S.P_DCSQ#1 . An example of the con- 
tents of the display control sequences is also given in 
Figure 1 . Accordingly, a start time (SP_DCSQ_STM) of 
SP_DCSQ#0 is set to 0. This means that a control se- 
quence starts at the fictitious time 0. Furthermore, the 
start address of the next SP„DCSQ 
(SP_NXT_DCSQT_SA) is set to SP_DCSQ#1 shown in 
the right naff of Figure 1 . The display of the sub-picture 
unit is started by the command STA_DSP. The color of 
each pixel type for the pixel data is set by the command 
SET_COLOR. In the present case the color of the back- 
ground pixels (bp) is set to 1 and the color of the pattern 
pixels (pp) is set to 0. 

[0022] The contrast mixture ratio between each pixel 
of the pixel data and the main picture is set by the com- 
mand SET_CONTR. In the present case this contrast is 
set to maximum. 

[0023] The sub-picture displaying the sub-title has to 
be placed within the main picture. Therefore, the display 
area of the pixel data are set by a rectangle with com- 
mand SET_DAREA. This command allows to set the 
display area individually by x and y coordinates. In order 
to determine the part of the PXD which is to be displayed 
as sub-picture the address of the first pixel data used 
for displaying is set by the command SETJDSPXA. The 
corresponding PXD start address is shown in the PXD 
graphic in Figure 1 . 

[0024] The sub-picture display control sequence 
SP_DCSQ#0 is terminated by the command CMD_END 
like each SP_DCSQ. 

[0025] The second and last display control sequence 
SP_ DCSQ#1 of this exemplary SP_DCSQT is shown 
in the right half of Figure 1 . Accordingly, the execution 
stop time is set to 527 units corresponding to 6 seconds. 
The following command-relating to the start address of 
the next sub-picture display control sequence does not 
produce any effect in the present case since 
SP_DCSQ#1 is the last one of the SP_DCSQT. The 
command STP_DSP serves to stop the display of a sub- 
picture unit. As already described above the command 
CMD_END terminates the display control sequence. 
[0026] The above described sub-picture unit is a part 
of a video object unit according to the DVD standard. 
[0027] Figure 2 shows a sub-picture color look-up ta- 
ble which represents a relation between a code number 
and a specific color. In the present case the pattern pixel 
color has been set to color "0" (compare Figure 1). The 
corresponding color coordinates for color n 0 a can be ob- 
tained from the first row of the sub-picture color look-up 
table of Figure 2. Furthermore, the background pixel 
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color is set to color "1". The corresponding color coor- 
dinates are shown in the second row of the sub-picture 
color look-up table. In such a way the pattern pixels and 
background pixels can be set to whatever color. 
[0028] The principle of the present invention is to 
transform data encoded to the M PEG sub-picture format 
to data encoded to the Teletext, Videotext or Closed 
Caption format. Thus, all of the sub-picture display con- 
trol sequences have to be transformed to the Teletext 
format, for example. This transformation will be exem- 
plarily explained on the basis of the transformation of 
the color setting. 

[0029] The Teletext standard provides few well de- 
fined colors as shown Figure 3. In general these colors 
are not identical with those of the color look-up table of 
the Figure 2. Therefore, during the process of transcod- 
ing or transformation the colors of the sub-pictures have 
to be compared with those of the Teletext. The color of 
the Teletext which is most similar to the color of the sub- 
picture is assigned to this sub-picture color. In the 
present case color "0" of. the sub-pictures is closest to 
color "red" of the Teletext. Similarly, color "1" of the sub- 
picture is closest to color "blue" of the Teletext. Conse- 
quently, the pattern pixel color of the sub-picture unit will 
be recorded as red Teletext color and the background 
pixel color of the sub-picture unit will be recorded as blue 
Teletext color. In any case it is verified that the pattern 
pixel color and the background pixel color are also dif- 
ferent in the Teletext. 

[0030] Another example for the transformation of the 
sub-picture display control sequences to Teletext stand- 
ard is given by means of setting the area of the sub-title 
within the main picture. According to the sub-picture unit 
of Figure 1 SET_DAREA is set to x=40..679; y=488.. 
527. The transcoder has to find the Teletext row which 
essentially corresponds to that area defined in the sub- 
picture unit. In the present case this area corresponds 
to Teletext row 22. Thus, the sub-title "Hello World!" will 
be displayed in Teletext row 22. 

[0031] The transformation of a DVD sub-picture into 
the Teletext sub-title format requires the analysis of the 
sub-picture for the following reason. A sub-picture unit 
comprises a run-length compressed bit map data unit 
and additional presentation commands. The presenta- 
tion commands of the sub-picture unit may be trans- 
formed directly to corresponding Teletext commands. 
However, in the sub-picture format the sub-title informa- 
tion is stored as bit map data whereas in the Teletext 
format the sub-title information is stored as background 
and characters. Therefore, pattern recognition of the 
painted text is necessary for the transformation of the 
sub-title from the sub-picture format to the Teletext for- 
mat. 

[0032] Pattern recognition of computer generated text 
as shown in Figure 4 is a well known technique. In the 
case of DVD sub-pictures the pattern recognition is sim- 
plified by the fact that only four different pixel types are 
used for DVD sub-pictures. Furthermore, the clear as- 



signment of sub-picture pixels for special uses namely 
background, pattern, emphasis 1 and emphasis 2 pix- 
els, additionally serves for simplified pattern recognition. 
As a result a pixel data bit map of the sub-picture unit 

5 of the present case is transformed by pattern recognition 
into the character sequence "Hello World!". 
[0033] As already mentioned above the sub-picture 
stream has to be analysed in order to transform the data 
to Teletext format. Such an analyses may be performed 

10 according to the flow chart shown in Figure 5. The anal- 
ysis of Figure 5 can be used for most kinds of. sub-title 
sub-pictures with two SP_DCSQs. Generally, a sub-title 
sub-picture unit does not include a command 
(CHG_COLCON) to change the color and contrast of 

15 pixel data. Thus, the following steps are performed dur- 
ing analysis: 

[0034] Step 1 contains the command to go to the sub- 
picture display control sequence SP_DCSQ#0. In step 
2 the colors used are obtained from the command 

20 SET_COLOR. In step 3 the assigned sub-picture look- 
up table colors are compared with Teletext colors (red, 
green, yellow, ...). Furthermore, the Teletext colors are 
assigned to the sub-picture colors, which are used in the 
sub-picture stream to be analysed, as definitely as pos- 

25 sible. Such assignment guaranties in most cases that 
the Teletext colors are similar to those of the sub-picture. 
In step 4 the SET_DAREA values are analysed in order 
to obtain the screen location of the sub-picture. After 
that, that Teletext row is chosen which comes closed to 

30 the screen location of the sub-picture. In step 5 the pat- 
tern recognition of the run-length coded PXD bit map is 
started. The SET_DSPXA values are used to detect the 
run-length coded bit map start positions of the top and 
button field inside the PXD. The SETJDAREA values 

35 are used to obtain the number of pixels per line. After 
that, the bit map is analysed with a pattern recognition 
algorithm to detect the characters of the bit map. In step 

6 the Teletext colors matching to the sub-picture colors 
are assigned to the characters and the background of 

40 the sub-title, respectively. Finally, in step 7 the end of 
the presentation of the sub-picture is obtained from the 
SP_DCSQ_STM value of the SP_DCSQ containing the 
STP_DSP command in the last SP_DCSQ. The formula 
to calculate the duration in units of seconds is 

45 SP_DCSQ_STM*64/5625. The Teletext sub-title is 
cleared after this presentation time, i.e. an empty Tele- 
text page or the next Teletext sub-title is displayed on 
the screen. 

[0035] In the case of Karaoke those passages or 
50 words of a sub-title are emphasized which have to be 
sung at the present moment. For this case steps 2 and 

7 have to be changed as follows: In step 2 all 
SET_COLOR commands and all CHG_COLCON com- 
mands of the sub-picture unit have to be read out. In 

55 step 7 the presentation steps of the sub-title, i.e. the Ka- 
raoke emphasizing steps have to be looked for until the 
presentation end of the whole sub-picture. The Karaoke 
emphasizing steps are defined by SP__DCSQ_STM val- 
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ues of the SP_DCSQs of each new CHG_COLCON 
command. As described above the presentation end of 
the sub-picture is defined by the SP_DCSQ_STM value 
of the last SP_PCSQ. The formula for calculating the 
duration of each steps in seconds relative to the start of 
the sub-picture unit is the same as that above. After 
each presentation step a new Teletext sub-title with an- 
other emphasized word or an empty Teletext page has 
to be displayed or the next Teletext sub-title has to be 
sent. 

[0036] The analysis of the sub-picture data has to be 
further changed if the sub-picture unit provides multiple 
sub-titles. Especially, steps 2 and 7 have to be changed 
like in the case of Karaoke and, additionally, as there 
are multiple sub-titles the presentation end of the sub- 
picture is defined by the SP_DCSQ_STM value of the 
next occurring SP_DCSQ containing the STP_DSP 
command. Furthermore, as indicated in Figure 5 by 
dash-lines the multiple sub-titles of a sub-picture unit re- 
quire an additional step 8 with the following branching 
condition: If there exist one or more SP_DCSQs after 
the SP_DCSQ being presently analysed containing a 
STP_DSP command, go to the SP_DCSQ just behind 
this SP_DCSQ containing the STP_DSP command and 
continue with step 4. 

[0037] The analysis of the sub-picture stream is the 
basis for transcoding sub-picture units into Teletext, Vid- 
eotext or Closed Caption. Since the sub-picture units 
are part of a sub-picture stream the respective com- 
mands of the sub-picture units will have to be analysed 
permanently due to their changes. The resulting effects 
are shown below: 

a) Each occurring SET_DAREA command may 
need a change of the sub-title location on the Tele- 
text screen. 

b) Each occurring SET_DSPXA command may 
need a new execution of the pattern recognition 
process. 

c) Each occurring SET_COLOR command may 
need a change of the text color. 

d) Each occurring CHG_COLCON command may 
need a change of the text color of some characters. 

e) Each occurring SET_CONTR command may 
need a dis- or enabling of the Teletext sub-title. 

f) Each occurring STP_DSP command needs a dis- 
abling of the Teletext sub-title. 

g) Each occurring STA_DSP command needs an 
enabling of the Teletext sub-title. 

[0038] Usually, each one of the events a) to g) above 
requires a change of the present Teletext sub-title page. 
[0039] The transcoding process forms a data struc- 
ture as required by the Teletext, video text or Closed 
Caption standard. In the present case the transcoding 
leads to a Teletext data structure as shown in Figures 6 
and 7, showing two representative rows of the Teletext. 
[0040] Figure 6 shows a Teletext row 0 obtained from 
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the sub-picture unit of Figure 1. The general structure 
of Teletext signals is provided by the international Tele- 
text standard. Accordingly, the Teletext signal for one 
page includes 24 rows. The first row 0, like a header, 
5 includes control information. The row is formed by a se- 
quence of hexadecimal numbers of two digits each. 
Thus, each code number is represented by 8 bit. At the 
beginning of the row the first three numbers represent- 
ing the clock run-in and the framing code are fixedly set 
10 for a given type of Teletext. The following magazine 
number "2" represents the hundred of the Teletext page 
number. The next Teletext number represents the 
number of the row. The next two numbers represent the 
ten and the unit of the page number of the Teletext. The 
is number of a sub-page of a Teletext page is coded within 
the next four hexadecimal numbers. Control codes for 
sub-title, new page etc. follow. 

[0041] The next rows of the Teletext signal contain 
specific information provided by the broadcasting facil- 
ity. Typically, sub-title information is sent within the last 
view rows. An example for such sub-title Teletext row is 
shown in Figure 3 on the basis of a row 22. The row 22 
also consists of a sequence of hexadecimal numbers. 
The beginning of the row 22 is identical with that of row 
0, namely including the clock run-in and the framing 
code. The next hexadecimal numbers represent the 
magazine and the row numbers. The next numbers are 
codes for the background color, the character set color 
and the characters to be displayed. 
[0042] As can be seen from the above, a Teletext sig- 
nal is a sequence of hexadecimal numbers separated 
in several rows. Each code word has a specific meaning 
like page number, sub-title or background color. 
[0043] The above-described transcoding process for 
transcoding sub-picture data to Teletext data is the fun- 
damental basis for including a sub-title stream into an 
MPEG video stream according to the present invention. 
This inclusion of sub-title stream into the video stream 
will be explained by means of the following example in 
connection with Figure 8. 

[0044] A DVD video disc contains a movie with two 
sub-title streams, namely an English sub-title stream 
SP#1 data and a German sub-title stream SP#2 data. 
This movie shall be copied to a DVD-VR disc. The first 
sub-title stream, the English one, is stored on the DVD 
video disc as sub-picture stream and will be copied to 
the DVD-VR disc as sub-picture stream SP#1 data 
(compare Figure 8). The second sub-title stream in Ger- 
man language will be transcoded into Teletext sub-title 
data and recorded as Teletext stream as specified in the 
DVD-VR Specification, Version 1 .0. As a result the data 
units of the audio and video streams AV data and those 
of the second sub-picture stream SP#2 data of the DVD 
video data are combined to an Audio-Video -Teletext 
stream AV & Teletext data of the DVD-VR data. Further- 
more, the first sub-picture stream SP#1 data of the DVD 
video data is copied without transcoding to the sub-pic- 
ture stream SP#1 data of the DVD-VR data. 
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[0045] In summary, the present invention provides the 
advantage that, compared to conventional DVD-VR, 
two independent sub-title streams per video object can 
be recorded on the DVD-VR disc instead of only one. 
Furthermore, the data transformation according to the 
present invention shown in Figure 8 is totally compatible 
to the DVD-VR Specification. Finally, the present inven- 
tion may be employed without additional hardware, 
wherein the complete data transformation is performed 
by software only 



Claims 

1. Method of recording data on a recording medium, 
wherein said data include video data and one or 
more first sub-title data, 

characterized by 

storing one or more second sub-title data as char- 
acter based information within said video data. 

2. Method according to claim 1 , further comprising an- 
alysing one or more sub-picture stream/streams 
comprising said second sub-title data before re- 
cording and transforming said second sub-title data 
into character based information. 

3. Method according to claim 2, wherein said second 
sub-title data are transcoded or encoded as Tele- 
text, Videotext or Closed Caption data. 

4. Method according to one of the claims 1 to 3, further 
comprising the step of labelling said character 
based sub-title information preferably by a flag in- 
side said sub-title data. 

5. Method according to one of the claims 1 to 4, where- . 
in said video and sub-title data are recorded as dig- 
ital information on a DVD disc. 

6. Method according to one of the claims 1 to 5, where- 
in said video data are encoded according to an 
MPEG video standard and include user data of a 
picture layer or a GOP layer and wherein said sec- 
ond sub-title data are stored within said user data. 

7. Method according to one of the claims 1 to 6, where- 
in said one or more first sub-title data are recorded 
as sub-picture stream/streams. 

8. Method according to one of the claims 1 to 7, where- 
in said sub-title data include user defined sub-title 
information. 

9. Device for recording data on a recording medium, 
wherein said data include video data and one or 
more first sub-title data, 

characterized by 



recording means for recording one or more second 
sub-title data as character based information within 
said video data. 

5 10. Device according to claim 9, further comprising an- 
alysing means for analysing one or more sub-pic- 
ture stream/streams comprising said second sub- 
title data before recording and transforming means 
for transforming said second sub-title data into 

10 character based information. 

11. Device according to claim 10, wherein said trans- 
forming means comprise transcoding means or en- 
coding means fortranscoding or encoding said sec- 

15 ond sub-title data into Teletext, Videotext or Closed 
Caption data. 

12. Device according to one of the claims 9 or 11 .further 
comprising labelling means for labelling said char- 

20 acter based sub-title information preferably by a flag 
inside said sub-title data. 

13. Device according to one of the claims 9 to 12, 
wherein said recording means include means for re- 

25 cording at least said video and sub-title data as dig- 
ital information on a DVD disc. 

14. Device according to one of the claims 9 to 13, fur- 
ther comprising means for inserting the character 

30 based sub-title information into the user data of a 
picture layer or a GOP layer of said video data, 
which are encoded according to an MPEG video 
standard. 

35 15. Device according to one of the claims 9 to 14, fur- 
ther comprising means for recording said one or 
more first sub-title data as sub-picture stream/ 
streams. 

40 16. Device according to one of the claims 9 to 15, fur- 
ther comprising means for entering user defined 
sub-title information into said sub-title data. 

17. Computer program product with program steps ac- 
45 cording to one of the claims 1 to 8. 

1 8. Recording medium comprising a computer program 
according to claim 17. 
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